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This study investigated the effect of providing students with varying 
forms ©f feedback during readiog on students' estinnates of understanding, 
actual comprehensiofi scores, and students' use of rereading aod reading 
rat© adjustmeot. Passages were presentee!, and reading behavior 
monitored, via cjomputer. Although students became more accurate in their 
estimates of understanding across the four passage segments (reduced 
iliusion of knowing), results indicate no effects of feedback on either 
comprehension or the processing measures. Results are discussed in terms 
of the relative resistance of metacognitive aspects of reading to 
short-term intervention among practiced readers. 
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y@tac@goitiorfi Is a term whidi refers to th@ knowtec^© oificsrfiirig c^nltiv© 
pmc@ss®s or pradiKits (Brown, 1980). On© asf^ of matacognition is the abi% to 
mgufat® ^rtiv® presses. Th©s@ f®gylatofy pmi^^as irsdyd© planning, ©valuatiog, 
anaS^zIng, and monitoring. !fi th® amm ©f readif^, !h@ term m®taccigoltion refers to 
metaosmprehension. Whan th@ goal of reading is ^mprehension, most of the cognrtive 
monitoring that follows Is comprehension monitoring. 

The monitoring of umJerstanding has ©merged as a ^n^m to researchers In the 
area of metacomprahenslon. Comprehension monltonng refers to the abliity to regulate 
ojigolng ^mprehensiofi pro^sses. Throyghout the literature, two c^m^nents of 
a>mprBh@nsion monitoring have been ki@ntlfl@d. Th@ evaluation (x^n^i^nent involves 
ohedcing one's current stat@ of knowlec^e and keeping trm^k of the syc^ss or fsulur© of 
ojmprehension processes. The second ojmponent is that ©f regulating comprehension 
pfDcessss. The Individual myst ensure that comprehension proceeds smoothly ami 
Implement appropriate corrective strategies to remediate compreheoslan failure. Those 
who monitor successfully know how to test whether understanding is adequate and how 
to deal with comprehension difficulties. Some strategies used to remediate 
comprehension dlffioifly include self-questioning, pausing, and re-reading. 

Comprehension monitoring has great educational relevance. The monitoring of 
comprehension processes provkies information which a learner may U3@ to make 
decisions about areas of study, ievei of umterstanding, and to detact when further 
clarification is needed. Without this knowSedg®, a- • indivldua! lacks vita! intomiation 
necessary to reach a level of more complete understanding. 
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i^umemus studies have Investigated th® reiatiofiship between the us© of 
a)mpmhe?islon monltorfr^ stril@gi@s wM^ reading and c^mpr@h@nsion of XhB text. 
Besu^ from r@s®arch fn^Mng childmn (Gamer & Reis, 19S1 ; GiBbe & Mann; Paris & 
Meyers, 19S1) and mkitls (Baker, 1979; Baker & Anderson. 1982; Mist, Simpson, & 
Hogrebe, 1985) indicate a strong c^rrelatlor^ between test scores and the us© of 
appropriate strategies. 

Evidence is gathering which indicates that the perception of understanding is 
related to the use of comprehension monitoring strategies. Awareness of 
comprehension failure pro\ddes a isasis for Implementing remedial strategies to 
enhance comprehension (Gamer, 1 980). Related to this issue is the conc^t of the 
illusion of knowing (IK). This term is used to describe the belief that comprehension has 
been attained when, in fact, comprehension hps failed. It Is evident that many learners 
do not assess their understanding of information accurately (Baker, 1979; Gamer, 1980; 
and Marknrian, 1 979). As additional support for the liiusion of knowing, minima! 
correlation was found between ratings of understanding and performance on a 
comprehension measure for both factual and Inferential material (Garhart and Hannafin, 
1986). 

Statement of the Problem 
The fact that learners think they understand when they do not, or Ignore their lack of 
comprehension, suggests ineffective monitoring of their comprehension. If the 

perception of understanding is related to the use of comprehension monitoring 
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Strategies, and th@ um of these str^egles Is related to m®r@ amjrate CTmpreheosion, 
thm incmasiog th@ amira«^ ®f th@ p#fcaptlofi of uftdefstanding may mmU in an 
ifi€f©^s@ io sonfipf©li0nsi®fi frooitoflf^ b@h0\^ofs. Sofn@ sug^sts that 

pmvidiog f@edba^ durlr^ replug may be eff®€tiv© in promoting Idaming (Cmmlns, 
StevenSo Ctements, & Kammenui, 19S2) ami s@!f assessmerit of urDcS©rslaodirig {Garhart 
& Hannafin, 1986). 

JhB mmnt research lw@stlga!®d tii© ©fleet of feedback on the iliusion of knovsiing, 
monitoring behaviors, perceived ^mprehsnslon and comprehension performance. 
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Method 

^^Jifl: The design seJecled for iWs ^ndy a 4 fFeecSsadc Groups) X 4 
(Passages) mlxgd factorial design. F@@ctiaci . Groups was a between subjects factor 
while F^s^© Segmsfits vms a ^hln subjects factor. Subjects ymm raodomly 
assigned to om of th@ four gro'ips. Group 1 read th@ foyr imssage segnten^ then rated 
th®!r comprighension (read onSy conirol). Group 2 r©ad th© four passag© segments, 
rated th@!r asmprehenslon, and osmpteted the comprehension measure {no feedback 
control). Group 3 read the passage segment, rated their ajmprehension, (XJmpieted 
the asmprehensbn rneasur©, and racelved aasorate fsedback ^ncemlng their 
performan^. Group 4 was the same as Group 3 except they reoatv^ controlled 
negative feedback about their performan^ (the nature of the controlled feedbadc wili be 
disoissed ^low). 

Subjects : The 67 eKperimerrtaf subjects were volunteers drawn from a screening 
group of 265 partldpants. Th® 67 expedmental subjects Included 19 nr^ales and 48 
females. The averse age of the subjects was 20.5 years. Th® subje^s vmra randomly 
assigned to four groups. Th® initial number of suojects per group was 1 7 In Groups 1 , 3, 
and 4 and 16 in Group 2. Two femaie subjects, one from Group 3 and one from Group 4 
were eliminated from the study due to errors they made in operating the computer 
during the session which rendered their data uninterpretable. One subject from Group 1 
was randomly eliminated from the study to obtain equal n's ot 16 in each group Scores 
of the experimental subjects on the Nelson Denny comprehension and vocabulary tests 
averaged 23.76 and 66.89 respectively. These scores are comparable to those of the 



7 



r@malnfng scr@@ning ptipulaHoo. Tter® w®r@ m sigoitom ^jff®r«nc®s bstweao groups 
with rospect to c^mpr©ti@osl©o sc^f®s. 

Passage ■■Saa ments. Eadi was asked to read four passage segm©ms, 
presented viaojmf 'Uter. These pasfagts w@m ^Japted from Gastiart ami Hannafin 
(1 i86). Ttwy were arranged sequentially. The intent eoncemed the discovery of a 
fictlooai ore (terk^iym oxide) on an imaginary Scytfi Seas island. The details ©f the 
material were fic^fous to avoid In! Iuef^ces of prior knowledge. In addition, the content 
was designed to avoki togi^t wifliets with oim^pts In the areas of history, easoomlcs. 
anthro|KJlogy. and mineral sdence. The material Included a high Information density 
within each passage to require students to sort among numerous fi^s and concepts. 
These passages were selected to ensure the presentation of sufflden! Information and 
to pose a challenge to the i^liege reader. Prevtous data indicate the percslved 
comprehension of the passages to be between 6.19 and 6.75 on a scale of 10. 

^gggment Measums 

Comomhenslon Measure . Ten five-choice muftlple choice questloos were 
osnstnicted for each of the four passage segments to measure sybjects' comprehension 
of thm. passage. I'hese questions were adapted to a multiple choice form^ from short 
answer questions used by Garhart and Hannafin (1986). Results of a pilot study 
indicated that the total item difficulty level was .58. The Item difficulty levels of each set 
of ten questions ranged from .51 on segment 3 to .62 on segment 1 . A KR-20 reliability 
estimate of .79 was obtained for the set of questions from pilot data. 
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Qu@sti0os involved ttie c^mprehen^on of materiai in the l@Kt ami required th@ ability 
to @x|#telfi, interpret, and ©vatyata infDrmation. Hwy eteslgrted to b@ chalfengiog 
@noygh for th@ styderii so that cM^mprehenslon monHoring/fostering acti^l@s would b@ 
ysMyi. Th@ miablites of tli© four ^mpmhension iroasyres wem commjled witli th© 
data from the @Kp@f1m@?ital subjects. Jh® results ^©kled raliabiiity estimates v^sch 
ranged from .78 for th@ questlofis of passage s@gm®n! 1 to .85 for the questions of 
passage segment 4. 

P^K^^Mre- Siibjeds were smn In groups of up to five for a one-hour experimental 
session. Sub|e<^ wer^ told that they wouW b@ reacfing four passage segments. Each 
segment wouki 1^ presented one sentence at a time on an Apple He mlcnM^mput@r. 
Subjects were abie to regulate the presentation of the text by pressing the "next" key 
(oKSed green) to go forward and the "back" key fc^ed red) to go backvsrafd within the 
passage segment. 

Subjects in all groups were in^rmsd that they wouW b© asked to rat© their 
OTmprehension of pass^e segment on a ^sale from zero (do not un^rstand) to 
tm (undei^tand perfeetly) after reading Ih© passage segment, and to typ3 their rating 
Into the computer when asked to do so. Due to the sybjedlve nMur© of "understanding " 
students may rate their comprehension bas^ on differing criteria. !n order to clarify tiie 
rating task, Instrydions regarding how to rate thef r comprehension were handed out to 
each student. These included brief explanations of the nymefieai rallnyb of the sc^le for 
subjeds to refer to during the session. A reliability estimate of the c^mpr&rsension 
ratings based on the data of th© experimefittl subfacfs yiek^ed a coefficient alpha of 



.836. 

Sy^ests If! Gmyps 2, 3, and 4 w©r@ iQfd tiTa!, after rating their compreliefision, th@y 
w@yld fe© asked t© answer t©n froiilipte choice questions psnalning t© the material 8o that 
passag® oo!^. Hi® muMpI® di©l^ quosttoris wr® proserrted on® at a tim® on the 
computer, ana th© subjects were lnsttiel©di to intikiat® their ansvsmr ^ prtsslr^ th® 
app-opriat@ ke^ for ihat response. After eompletitig the questions for th© first passag®, 
th® su^ects pro€@@<jQd to passages 2, 3, and 4 a! their own rate. 

Subj^s In Groups 3 bM 4 rec@lv®cf feedback after answsririg each set of tm 
questions. Subjects In Group 3 received amjrat® feedback regastling their 
pefformances on the questions after answering each set of ten questions. This 
feedb^k involved Informing them of the number of questions they answered ojrrec^ly 
out of ten. Subjects in Group 4 received ointrolfed negartlve feectoack after answering 
each set of ten questions, if the subject's actual so^r® was less than or equal to six, then 
h®/sh® rec3ived accurate feedback. When th© subject's s«^re exceeded sIk, the 
feedb^k 'le/she rec^iv^ was "six correct" This ensured that the maximum reported 
score any Individual m Group 4 received was no more than six. 

P f p^nd ^nt Measures : Th© CTmprehension raungs of each subjed in alt groups were 
recorded. The i^rfomtenc^ of subfects in '^mups 2, 3, and 4 on the oimprehension 
questions were moirded as the number of questions answered asrreetty out of ten for 
each passage s^ment. 

Two aspects of ojmprehension monitoring were retarded for all subjects. The 
computer ke|^ track of the use of rereading (numfcmr of regressions mad© wtthin each 
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passage segment}, md ths av@r^© reading rat® in words p©r minyt® was eomputad for 

A §ml m®mmm derived from sufejeas In Qmups 2, 3, and 4 is an ilfuston of knowing 
fiK) sc^f@. This was represented by the dICfersne® bttween a syblect' s estimate of 
^nipf®h@nsiDn and higher actual perfofmance on th@ comprehension m®asur© for 
each passage segment Greater cWerenc© scares Indfcated a greater IK, smatier 

diff©r©nc© scores indicated a sr^ialter iK. 

RESULTS 

iilysfon Qf Knowing: A 3 X 4 (Group X Passage) ml%^ facSoriat analysis of variance 
{AHOyA) wan performed with IK seores as the depesKlent variable. Table 1 presents th© 
celt means and standard deviations ^r this analysis. The AHOSfA gelded s significant 
main effect for Passage (F (3,135) « 8.89, p< .01). 

Th© IK was obtained by subtracting a subjed's comprehension ^re from his/her 
comprehension rating for each passage segment A positive sosr© indicated that th© 
subjec^t overestimated his comprehension. A negative score indicated an 
underestimation of comprehension. 

The WSD follow-up tests indicated the mean IK score for Passage 4 (X = -.67) to be 
significantly lower than the mean IK score for Passage 1 (X « .29). Passage 2(X = .98). 
and Passage 3 (X .29). No significant cifferences were found between Passages 1,2, 
and 3. 
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Means and Standard Dsviatiens for Groyps on IK Scores 





Pass® 


g®1 






Pass 


ag®4 






SO 


Mmn SO 


MBm SD 




SD 


Group 2 


.38 


2.39 


1.69 1.6S 


.75 1.06 




1.71 


Groups 


-.06 


1.95 


.31 1.06 


.OS 2.05 


-1.90 


2.26 


Group 4 


M 


1.79 


.94 2.08 


.19 2.01 


-.25 


1.65 



U for aft mils ©quailed 16 



Reading Rate : A 4 X 4 (Group X Passage) mixed factorial ANOVA was psrformsd 
with HB in total words per mlniA® as ttm d@fmn^tt varlabl®. Th® AMOVA yielded no 
significant @ff@cts. The c^li m@aris and star^ard deviations for this analysis are included 
In Table 2. 

Tabl@2 

Means and Standard Deviations tor Groups on RR 





Passage 1 


Passage 2 


Passage 3 


Passage 4 




Mean SD 


Mean SD 


Mean 


SD 


y@an SD 


Group 1 


109.25 26.18 


130.44 33.65 


120.94 


29.07 


128.44 36.35 


Group 2 


117.63 78.35 


114.38 28.80 


111.38 


36.09 


108.63 30.06 


Group 3 


109.94 35.^ 


115.06 44.80 


102.50 


26.44 


102.94 25.01 


Group4 


117.81 23.82 


128.69 34.73 


117.00 


27.91 


129.13 29.46 



N tor all cells equalled IS 
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B^m^toSlA 4X4 (Group K Passage) mixed facstoria! ANOVA was performed with 
REG ; thB cl@p@relem variMsl©. The ANOVA yields a signlf cant ma!o ®ff@c^ for 
passag© (F (3,1^) ^ 4.47, p< .01). Tli@ msans ami standard deviatlonr for Mb analysis 
ar© p-esented In Tab!© 3. 

TIte WSD foltow-up tests ir^dicated th® mmn number of regmssions for Pass^e 2 (X 
« .56) to b@ less than the mean number of regressions for Passage 1 fX = .83), Passage 
3 (X = 1 .25), ®fid Passag® 4{X~ .95), ThB mean number of regressions for Passage 3 
was also found to be :slgnificantly greater than Pass^^®s 1 and 4. Th@ mean number of 
regressions for Passages 1 and 4 w®r© not signlflcartV cflff®§«nt. 

TM>!e3 

Means artd Standard Deviations for Groups on REG 



Passage 1 Pass^je 2 Passag® 3 Passage 4 



Moan SB mm SO Mean SD Mean SD 

Group 1 1.06 1.69 .75 1.18 1.19 1.33 .69 1.01 

Group 2 .81 1.^ .44 .83 1.19 2.34 1.19 1.43 

Groups .75 1.00 .69 1.01 1.44 1.55 1.13 1.31 

Group 4 .69 1.35 .38 .72 1.19 2.04 .81 1.17 



for all cells equaited 16 

fVifrmffih^nsinn glares: A 3 X 4 {Gmsp X Passage) mixed factorial ANOVA was 

performed with CO scares as th@ d®p@fidi*fit varlabl©. Th© ANOVA yielded a significant 
main ©ffe^ tor Passage fF |3,135| « 5.35, p< .01 1. Th® mmm am standard deviations 
are presented in Table 4. 
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IhB WSD folfow-up t®sts Indicated th@ mean comprehension s^re for Passage 4 {X 
= 6.75) to lyt greater than th@ mmn wmpmlmn^on score for Pas^e 1 |X sj-* |, 
Passage 2 (X « 6.10), ar^ Passage 3 (X b BMB). Jh&rQ ware ik^ signlicant 
dlff@r@nces befw©®R Pass^@s 1 , 2, and 3. 



Table 4 

y©ans and Standard Deviations for Groups on CO 





Passage 1 




Passage 3 


Passage 4 




y@an SO 


h^an SO 


yean SO 


yean SO 


Groups 


5.88 2.03 


5.75 1.13 


5.69 1.30 


6.81 133 


GroypS 


5.81 1.38 


6.31 2.02 


6.06 1.88 


6.94 1.65 


Group 4 


5.75 1.24 


6.25 1.65 


6.19 1.11 


S.SO 1.67 



M for all cefis ©qyaliod 16 



ComprehensiQO Batinps 

A 4 X 4 (Group X Passage) mixed factorial ANOVA was p©fform®d mth OR as the 
depertden! variable. Th© ANOVA yielded a significant main effect for Passage (F 
(3,180) a 10.95, p< .01). The means and standard delations are presented in Table 5. 

Tlie WSD foltow-up *®^s Ifidisated the mean c»mpreh©nsfon ratlog for Passage 2 {X 
s 7. 11 ) to be signlficantty greater than the mean ojmprehension rating for Passage i {X 
E 6.14), Pas.sage 3 (X =6.25), and Passage 4 fX = 6.22). Them were no signiflcam 
differences between iiiean ratings for Passage 1 , 3, and 4. 
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Tables 

M®mB ami StandartI Deviations for Grayps on CR 

Passs^ 1 Pass^® 2 Passage 3 Passage 4 

MQm SO y@an SO Mean SD M@an SD 

Greypi 6»25 2.35 7J3 1.71 6J3 1^ 6.S3 1.86 

Gfoyp2 6.25 1.91 7.50 .97 6.58 .96 6.2S 1.24 

Groups 5.75 1.69 6.63 1.31 6.00 1.63 5.75 2.05 

Group 4 8.31 1.58 7.19 1.56 6.31 1.78 6.25 1.73 

N for a!i c^fSs @qyaii@d 1 8 ' — — . 

Dye to th@ fact that there were m Group effects nor Group X Passage interactions 
found, it was dedded to investigate the oirrelations betvveen Comprehension Ratings 
and Comprehension Scores. TabSe 6 presents the oimfatlon matrix 1m CR and CD. 

Tables 

CorrelatlOff MatriK for CR and CO 





001 


002 


COS 




CR1 


J3 


.11 


.12 


.24 




.11 


.46 


.41 


.10 


CR2 


.22 


.06 


.17 


.36 




.13 


.67 


•^8 


.01 


CR3 


.21 


.03 


.27 


.41 




.15 


.83 




.004 


CR4 


.2Z 


.18 


.51 


.m 




.14 


.21 




m 
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F©ur s^rtWcarit comeEations w@f® found, thme of thos® being off the diagonal. The 
only sigoiflmnt diagonal ^rmlaffof! was that l^tw©@n CR4 and C04. 

ami monitoring behaviors, it was hypothesized that subj^s v^q rscelv^ feedback 
mgai^lng their performan^ on a comprehension measure would show a decrease In IK 
arxf wufd Increase their us@ of monitoring strategies. 

ft appeared that providing feedback had little effect on the subjects' IK, as tiie groups 
did not sfgntllcantly differ. This ^gests the Impotence of short term leedbaA on 
aiteHng subje^s' l^haviors. Results did imli^e, however, a osrsve^en^ of 
performarx^ and perceptbn for ail subjects on the foytth i^ssage segment. Although 
direct feedback dki no! effe<^ sybjects' IK. It is possible th^ as stiKfents gained 
experience with the compreiien^oR questions, they were b^mr able to estimate their 
ynd^rslanding which resulted In this ^nve^ence. It is highly unikely tha! the lack of 
signii^nt (fifferem^s between the groups wth respect to IK was due the measyres 
since both had high calculated reliability. 

The correlations between comprehension ratings and o^mprehereslofi scores for 
each passage segment yielded results consistent with the Endings of Garhart and 
Hannafln (1986). The correlation was not significant until the fourth sagment, but the 
effect eppearad to be progressive from segment 3 to 4. This provides actional support 
for the idea that as students gained experience with the questions they were better able 
to predict their performance on subsecpjent segments. 
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irsforming th® subjects of how rmny flams they missed on the osmpretiension 
measure also prov^ to hav® ittte sffai^ on sub|«^s' madirtg ra!© ami ys@ of 

Ofi® possibi® ©Kptenatian €^nt@rs arouml thB mtlon ttet asmprehension moottoring 
behaviors are acquimd over a br^ period of tfm©. Thus, they are not Kkefy to be 
changed in a sixty-minute session. Although the sybjects were aware of performing 
poorly and may have wanted to improve, it is unlii^ely that they would suddentiy change 
routinely employed strategies. Adcitlonally, initiation of additional ^mprehension 
monitoring ac^vrty may be triggered Internal ©valuation operating wher^ Illusion of 
Knowing is reeognized concurrent with reg^Jing. Sinc^ feedback was provided after a 

segment, such may not have affeded evaluation of subsequent segments. 
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